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Cognitive Determinants of Analogical 

Reasoning on Intelligence Tests * 
The present study is an attempt to learn about the cognitive compo- 
nents of performance on standardized intelligence tests. The focus of this 
investigation is on number analogies, because they exemplify a prominent class 
of aptitude tests ^ rule induction problems. Rule induction is of special con- 
cern because factor analytic studies have frequently identified it as an 
important factor emerging from the aptitude test performances of both adults 
and children (Thurstone and Thurstone^ 1941; French ^ 1951; Adkins and 
Lyerly, 1952; Guilford^ 1967; Cattell, 1971; Ekstrom^ 1973). The regular 
occurrence of this factor in many test batteries suggests a close relationship 
between inductive reasoning and school success > making this an especially 
important competency for educators to learn about. Furthermore, ah investi- 
gatidri of inductive reasoning may yield some information about the psychological 
components of other intelligence factors as well, since Thurstone and Thurstone 
have asserted that rule induction, as a second order factor, may actually be 
Spearman's g. 

Objectives 

Three sets of issues will be examined in this presentation. Firsts an 
attempt will be made to identify some of the major solution requirements im- 
posed by different types of number analogies and to assess the influence of 
those requirements oh rates of solution. Secohd, ihformatibh is sought about 
the nature of intellectual development. This will be obtaihed by comparing 
the performances of subjects of different ages oh distinct types of analogies 
to determine whether certaih processing demands exert greater influences at 
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one age level than another. Finally^ an effort will be made to identify the 
types of solution requirements that are most responsible for the individual 
differences in performance that accompany psychometrically devised intelligence 
tiests. This will be accomplished by identifying specific solution require- 
ments that discriminate between subjects of distinct mental ages within a 
given chronological agiB group. 

Method 

Materials 

Since standardized tests often confound changes made along two or more 
problem dimensions, and since there are usually only a few instances of any 
particular task characteristic, it is often difficult, if not impossible, to 
determine the independent contribution of each identifiable processing demand 
to test performance. To circumvent these limitations, 44 number analogies 
were especially developed for this experiment. These analogies incorporated 
atld mariipiulated tlie same features that a preliminary study had shown to be 
characteristic of standardized tests. However j the experimentally devised 
problem isiet was more systematic in its manipulation of task characteristics 
and contained more instances of those characteristics for greater reliability 
in revealing sources of solution difficulty. 

As illustrated in Table 1, the experimental number analogies consisted of 
two complete pairs of terms and a third pair that the subject had to complete. 
The problems differed from each other according to the number of arithmetic 
operations that were applied to one member of a pair to generate the other mem- 
ber, according to the qualitative categories of these operations (e.g.^ addition 
silbtractioh, multiplicatibri ^ etc.).^ according to the magnitudes of these opera- 
tions (e.g., +1 versus +12), and according to their ambiguity in suggesting a 
sblutidri riile. 
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Subjac-ts^ 

To permit the iBXpldratioh of sources of diBvelbpmiBhtal differences, the 
experimental number analogies were administered to subjects at two different 
age levels, fourth and fifth grade children and adult college students. To 
allow further insights into the nature of individual differences in intelli- 
gence, the fourth and fifth grade subjects were selected into two distinct 
groups on the basis of previously obtained IQ scores, an average intelligence 
group, with iQ's ranging from 86 to 103; and a high intelligence group, with 
IQ's ranging from 130 tc 158, Altogether then, differences in age and general 
intelligence were represented by three groups, and 18 subjects were assigned 
to each of them. 
Procedure 

Before attdmpting the experimentally devisied riiimber analogies, all sub- 
jects were administered all gradie lievels of thiB number analogies portion of 
the Analysis of Learnirig Potential (ALP). This instrument was presented in a 
grbtip setting, using the standard paper-and-pencil format and time limitations 
prescribed in the test manual. The ALP analogies provided an opportunity for 
a subsequent check on whether the experimentally devised items were assessing 
the same competencies as the standardized test items that they were pur- 
portedly modeled after. If the total scores on the experimental instrument 
positively correlate with those on its standardized counterpart, this would 
support the relevance of the experimental test results to the standardized 
tests that are the ultimate focal point of this research. 

Several days after the administration of the ALP, subjects were individually 
tested on the experimental analogies. One item was presented at a time on the 
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screen of a CRT compater terminai, and the subject was allocated up to 75 
seconds to type one number into the computer to complete the pairi 

Results 

All subjects completed the ALP number analogies and the experimentally 
devised problems. The correlations between the scores on these two instruments 
indicated that the experimental test was achieving its purpose in systematically 
assessing cbmpetehcies underlying standardized test performances. For the 
average IQ children, high IQ children^ and adults ^ respectively ^ the Pearson 
correlations between total scores bri the two iristrumerits were .71 (^^ < .001), 
.76 < .001), arid .58 (£ < .05). 

To determirie the prbcessirig diemarids that most affected performance dri 
thiB analogies, a series of multiple regression analyses were employed. So- 
lution probabilities for individual analogies in the experimental set 
constituted the dependent variable, and the experimentally manipulated task 
characteristics were the predictor variables. These analyses indicated that 
two general classes of solution requirements determined the difficulty of the 
problems. These can be referred to as domain-specific knowledge demands and 
general procedural knowledge demands. For number analogies ^ the needed domain- 
specific knowledge entails an understanding of the sequential nature of 
numbers, as well as skill in recognizing and executing specific arithmetic 
operations (e.g.^ addition by twb^ division by three, etc.). Ori the other 
hand^ the general procedural knbwledge involves the cobrdiriatibn of solution- 
related irifbrmatibn in wbrking memory while assembling and verifying a solution 
rule for the analogy. 
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Working Memory Demand 

Of the different predictors included in the regression analyses, the most 
influential one for ail three groups of subjects was a general procedural 
knowledge requirement, the working memory load imposed by an item. Number 
analogies vary in the number of arithmetic operations that their solution 
rules incorporate^ and the more operations that must be assembled and kept 
track of^ the more mental work space is requited. For example, item 1 of 
Table 1 makes a minimal demand on working memory because the examinee has no 
numerical transformations to remember in completing the third pair. The 
answer is really in external memory. It's the same number that occurs in the 
first position of the third pair. On the other hand^ Item 2 makes slightly 
greater demands bri working memory. * There ^ the examinee must notice the 
existence of a +3 relation between the members of each pair, mentally apply 
that operation to the first term of the third pair, and then holc^ the result of 
that operation in working memory long enough to fill in the blank. Item 6 
imposes still greater memory demands. To solve that analogy, the examinee 
must notice, retain, and execute two distinct operations which are applied in 
sequence » x2 and +1. Apparently » these increases in solution-related informa- 
tion quickly overload the limited mental work space that most people possess 
arid constitute the most critical determinant of item difficulty for this type 
of task. 

To investigate sources of developmental and individual differences in 
analogical reasoning, a two-way analysis of variance was applied to the data. 
Item features and subject characteristics were the independent variables ^ and 
solution rates for individual items again constituted the dependent variable . 
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As expected^ adaits performed successfully on significantly more problems than 
children did (80% versus 52.5%, £ < .001), and high IQ children solved signi- 
ficantly more problems than average IQ children (58% versus ^7%, g < .05). 
Moreover, the age of the subjects interacted with the memory demands of the 
analogies (£ < .001). As can be seen in Figure 1, a major decline in the 
children's performances began as soon as any increases occurred in information 
cdbrdinatidn demands beyond the repetition of a single integer. The adaits, 
on the other hand^ performed with almost the same accuracy for the first two 
iriformatibn coordination levels ^ but were seriously impaired at the third, and 
most demanding^ level. This pattern of interaction effects is consistent with 
research by Pascual-Leorie (1970) arid Case (1972^ 1978) suggesting that the 
effective capacity of a persbri's iofbrmation mariagemerit space ^ br working 
memory, iricreases develbpmeritally . Evidently, the adults iri this study had 
evolved more storage space or better strategies for using that space which 
eriabliBd them to effectively manage more rule-related irifdrmatibri than their 
younger counterparts. HowiBver, even those expanded capabilities iBventually 
become inadequate as the highest memory level problems were encountered. 
Dofliaijt-Sp ec i f ic Kn owl e d^e Deman ds 

Besides the role played by working memory in determining analogy per- 
formance; the raaitiple regressionis and analysis of variance implicated 
relational ambiguity as a critical influence on solution. In some problems ^ 
like Item 2 of Table 1, an examination of the first pair immediately suggests 
one relation that can be employed to cbrrectly cbmplete the prbblem^ addition 
by three in this case. Sometimes^ hbwever^ there are competing br misleading 
relations which can be eliminated bnly by testirig their applicability tb the 
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second pair as weii as the first; For example, an initial glance at the first 
pair of item 3 might suggest the employtnent of a x2 relation rather than the 
+2 that is actaaiiy required. Likewise, an examinee would probably hyiDothesize 
+4 as the relation governing item 6 until it was checked for applicability to 
the second Dair. Ambiguity is thus a domain-specific variable, since it re- 
sults from different levels of familiarity with distinct types of arithmetic 
operations. However, it also involves elements of general procedural knowl- 
•'dge^: ^i'nce the misdirections caused hf ambiguity can be overcome by a 
verification strategy that checks for consistent occurrences of a relation 
across all pairs of the analogy. 

All three groups of subjects had difficulty solving items with ambiguous 
first pair relations. In fact, when this variable was employed with working 
memory demand as the sole predictors of performance, the resulting regression 
equations accounted for most of the sdliiticn v .riarice among the 44 ariaibgv 
items for all three groups of subjects: 87% for the average IQ children j 
86% for the high IQ children, and 74% for zhr adults (all £'s < .001). 

Other processing demands specifically tied to the numerical content 
domain also contributed to subjects' performances on the number analogies. One 
of these was the magnitude of the arithmetic operation required to generate 
the second member of the pair from the first. When single transformation 
analogies were divided into two groups on the basis of the relative magnitudes 
of the arithmetic dperatioris they employed (e.g.. Item 2 versus Item 4 in 
Table 1), comparisons of the two sets indicated that the high magnitude analogies 
were considerably more difficult than their lov7 magnitude cbuhterparts 

< .001). Furthermore, as illustrated in Figure 2, magnitude interacted with 
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the age of the subjects (jj- < .01). Both adults and children were impaired by 
high magnitude operations, but these effects were clearly more serious for 
the children. 

In addition to magrtitudie, the qualitative category of arithmetic operations 
affected subjects' performances. As shown in Figure 3, this task dimensidri 
interacted with both the age level (£ < .001) and the intelligence level 
(£ < .05) of the subjects. The adults did quite well on all types of number 
analogies, but they solved items involving maitiplication and division with 
somewhat greater accuracy than those involving addition and subtraction. 
Similarly, the high IQ children did slightly better with multiplication and 
division than with addition and subtraction. However, the average IQ children 
solved nore subtraction analogies than division analogies^ while performing 
equivaleritly on addition and multiplication* Apparently, the adults, arid to 
some extent the high IQ childrerij had a good cbihiriarid of both the multiplication 
and division tables. This enabled them to readilv detect arid accurately apply 
multiplication arid division operations wheri they came up iri the arialbgies. On 
the other harid, while the average IQ fourth arid fifth grade children had 
acquired skill in multiplicatidri that matched their high IQ counterparts, they 
still had riot developed proficiency with tabled division operations. This in- 
adequacy in domain-specific knowledge appears to be directly responsible for 
the inferior performance of these children on a number of test items. Further- 
more, Figure 3 suggests that the average IQ children were affected by the 
direction ot the operations in the anaJogies. Both incrementing operations 
(addition and multiplication) were clearly easier for them than either 
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decrementing operation (subtraction and division) . No such effect was apparent 
for the high IQ children or the adults. 

Discxission 

Together, the analyses presented here indicate that analogical reasoning; 
and probably other intelligence test performances as well, can be explained 
in terms of an interactive system of cognitive processes. Low test scores may 
be due to inadequacies in general solution procedures, including poor manage- 
ment of information in wortcine memory and failures to fully test the 
appropriateness of hypothesized solution rules. However, it is quite notable 
that failures on tests of abstract reasoning sometimes result from inadequate 
knowledge of facts and skills directly taught arid practiced in school. The 
superior scores of the adults iri ttiis study resulted from greater proficiencies 
with both of these classes of sbliitibri skills. On the other hand, doniain- 
specific knowledge alone was the major source of solution discrepancies between 
children of different general intelligence levels. The challenge for future 
research is to better specify the mechanisms associated with the activation 
arid growth of these different solution determinants and to use this kind of 
analysis to augment the diagnostic power of standardized tests already valued 
for their predictive capabilities. 
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table 1 

Some Different Types of Number Analogies 

1) No Numerical Transformations (Identity Relation) 
2:2 7:7 23: 

2) One Low Magnitude, Unambigaous Addition Operation (+3) 
25:28 4:7 65: 

3) One Low Magnitude, Ambiguous Addition Operation (+1) 
2:4 7:9 3: 

4) One High Magnitude^ Unambiguous Addition Operation (+12) 
5:17 19:31 30: 

5) One High Magait^de, Ambiguous Subtraction Ojieration (-12) 
24:12 22:10 38: 

6) Ambiguous, Twd-Operatidn Relation (x2, +1) 
3:7 11:23 10: 
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Figure 1. Percentages of correct solations for namber analogies 
requiring different numbers of transformations. 
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Fiyjre 2. Percentages of correct solutions for number analogi 
requiring different magnitudes of arithmetic operations. 
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Figure 3. Percentages of correct solations for number analogies 
requiring different qualitative categories of operations. 
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